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Many  phenomena  can  be  modelled  as  signals  to  vdiich  noise  has 
been  added.  Frequently,  it  is  assumed  that  the  noise  is  governed 
by  the  so-called  Gaussian  probability  law.  If  the  signal  itself 
is  non-random,  the  most  important  questions  are  entraction  of  the 
signal  and  description  of  the  noise.  Statistically  these  are  the 
problems  of  estimating  the  mean  and  covariance,  respectively,  of  a 
Gaussian  process.  A  classical  statistical  method,  maximum 
likelihood  estimation,  breaks  down  when  the  signal  is 
"infinite-dimensional,"  which  is  the  case  in  many  applications. 

^  The  method  of  sieves  often  provides  reasonable  estimators  in  such 

a* 

circumstances,  and  the  PI  has  introduced  sieve  estimators  for  the 


mean  and  covariance  of  a  Gaussian  process.  This  project  is  aimed 
in  part  at  investigating  the  properties  of  these  estimators,  with 
no  assumptions  on  the  "time"  parameter  (it  is  only  assumed  to  be 
an  element  of  a  set  T). 

A  sieve  estimator  is  doubly  indexed.  The  first  index,  say  n, 
is  the  sample  size  -  in  this  case,  the  number  of  realizations  of 
the  process  that  one  observes.  The  second,  say  d,  is  a  sieve 
parameter.  Both  these  indices  are  allowed  to  increase  without 
bound  to  obtain  certain  asymptotic  properties  of  the  estimator; 
one  typically  requires  that  d  go  to  infinity  at  some  rate  with 
respect  to  n.  For  a  more  complete  account  of  sieve  estimation, 
see  Grenander  11981]  or  Geman  and  Hwang  119821. 
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The  first  goal  of  this  project  is  to  develop  the  properties 
of  a  new  sieve  estimator  for  the  mean,  say  m(t),  of  a  Gaussian 
process  when  the  covariance  is  known.  Let  X  be  the  reproducing 
kernel  Hilbert  space  of  the  covariance  function;  then  M  is  the  set 
of  all  possible  mean  functions  of  the  process.  Consider  the 
following  condition: 

(S)  the  true  mean  function  belongs  to  a  known  separable 
subspace  of  9(. 

(If  3(  is  separable,  we  take  K.  =  ^.  >  The  sieve  estimator,  say 
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m(t),  is  defined  in  terms  of  a  complete  orthonormal  basis  of  a 
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precise  definition  of  m  is  given  in  the  project  proposal.  The  PI 
has  now  shown  the  following: 

a.  For  fixed  n  and  d,  the  estimator  m(t>  is  a  Gaussian 
process.  Uhen  (S)  holds,  one  can  give  a  simple  formula  for  the 
mean  and  covariance  of  m(t),  from  which  one  can  show  that,  at  each 
t,  m(t)  is  asymptotically  unbiased  as  d  -4  oo  and  is  weakly 
consistent  for  m(t)  if  d  =  0(n). 
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b.  Both  m  and  m  are  elements  of  W,  and  using  the  norm  of 

as  a  metric  one  can  show  that  the  distance  between  m  and  m  goes  to 
zero  almost  surely  under  two  assumptions:  (i>  that  (S>  holds,  and 
(ii)  that  d  -»  <x>  and  d/n  O  as  n  -•  «>.  This  is  "best  possible"  in 
the  sense  that  if  d/n  c  >  0,  then  one  cannot  even  get  weak 
convergence  of  the  distance  to  zero. 
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The  second  part  of  this  project  involves  the  estimation  of 
the  covariance,  say  R,  of  a  Gaussian  process  whose  mean  is  known 
(and  may  be  assumed  to  be  identically  zero).  In  the  project 
proposal  the  PI  conjectured:  when  the  Hilbert  space  9(  above  is 
infinite  dimensional,  the  likelihood  function  of  the  covariance  is 
unbounded,  so  that  the  maximum  likelihood  estimator  (MLE)  fails  to 
exist. 

c.  The  above  conjecture  has  been  proved.  In  particular, 
consider  this  condition: 

(C)  The  true  covariance  is  specified  by  a  bivariate  expansion 
using  a  fixed  countable  orthonormal  set  in  H. 

The  PI  has  shown  that  the  HLE  exists  almost  surely  if  the  set  in 
(C)  is  finite,  and  fails  to  exist  (the  likelihood  being  unbounded) 
almost  surely  if  the  set  of  infinite. 

Thus  a  sieve  estimator  is  necessary  in  general,  and  the 
"finite’'  case  above  actually  leads  to  a  natural  sieve  estimator  R, 
with  dimension  d  as  sieve  parameter.  The  PI  has  established  the 
f ol lowing . 
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d.  VIhen  (C)  holds,  the  estimator  R,  viev^d  as  a  stochastic 

process  on  TXT,  has  a  simple  distribution  in  terms  of  independent 
2 

\  random  variables,  from  which  it  follows  that,  at  each 

/s 

(s,t)  £  TxT,  R(s,t)  is  asymptotically  unbiased  as  d  -»  «>  and  is 
weakly  consistent  for  R(s,t)  if  d  =  0(n). 

The  coefficients  in  the  expansion  in  (C)  form  a 


square-summab le  sequence,  so  we  may  reparametrize  the  model  by  a 


2  2 
subset  of  an  -C  -space.  Using  the  metric  defined  by  the  €  -norm, 

the  PI  has  shown  the  following: 

e.  If  d  -»  00  and  d/n  -4  0,  then  we  have  strong  consistency  in 

2 

€  ,  under  assumption  (C). 

2 

f.  The  metric  in  t  is  equivalent  to  a  natural  distance 
between  covariances  given  by  the  norm  in  9<  0  the  second 
symmetric  tensor  power  of  K. 

Aside  from  further  investigation  of  these  sieve  estimates, 
the  next  goal  of  the  project  is  to  weaken  or  remove  a  restriction 
of  continuity  placed  on  a  filter  for  a  stochastic  Gaussian  signal 
invented  by  H.  Driscoll.  Details  are  given  in  the  Pi’s  project 
descript  ion . 
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